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We have recently defined a weak Markovian bisimulation equivalence in an integrated-time setting, 
which reduces sequences of exponentially timed internal actions to individual exponentially timed 
internal actions having the same average duration and execution probability as the corresponding 
sequences. This weak Markovian bisimulation equivalence is a congruence for sequential processes 
with abstraction and turns out to induce an exact CTMC-level aggregation at steady state for all 
the considered processes. However, it is not a congruence with respect to parallel composition. In 
this paper, we show how to generalize the equivalence in a way that a reasonable tradeoff among 
abstraction, compositionality, and exactness is achieved for concurrent processes. We will see that, 
by enhancing the abstraction capability in the presence of concurrent computations, it is possible to 
retrieve the congruence property with respect to parallel composition, with the resulting CTMC-level 
aggregation being exact at steady state only for a certain subset of the considered processes. 

1 Introduction 

Several Markovian behavioral equivalences (see HI and the references therein) have been proposed in 
the literature for relating and manipulating system models with an underlying continuous-time Markov 
chain (CTMC) [15] semantics. However, only a few of them are provided with the useful capability 
of abstracting from internal actions. In particular, [3] has recently addressed the case in which internal 
actions are exponentially timed - rather than immediate like in 111 - by defining a weak Markovian 
bisimulation equivalence inspired by the weak (Markovian) isomorphism of ifTTl . The idea is to reduce 
to individual exponentially timed internal transitions all the sequences of exponentially timed internal 
transitions that traverse states enabling only exponentially timed internal actions, with the reduction 
preserving the average duration and the execution probability of the original sequences. 

From a stochastic viewpoint, this reduction amounts to replacing hypoexponentially distributed du- 
rations with exponentially distributed durations having the same expected value. As a consequence, 
processes related by the weak Markovian bisimulation equivalence of |3| may not possess the same 
transient performance measures, unless they refer to properties of the form mean time to certain events. 
However, those processes certainly possess the same steady-state performance measures, because the ag- 
gregation induced by the considered equivalence on the CTMC underlying each process has been shown 
to be exact at steady state. 

The weak Markovian bisimulation equivalence of 131 is not a congruence with respect to parallel 
composition, a fact that limits its usefulness for compositional state space reduction purposes. The con- 
tribution of this paper is to show that compositionality can be retrieved by enhancing the abstraction 
capability of the considered equivalence in the presence of parallel composition. The basic idea is al- 
lowing a sequence of exponentially timed internal transitions originated from a sequential process to be 
reduced also in the case in which that process is composed in parallel with other processes enabling 
observable actions. Unfortunately, there is a price to pay for achieving compositionality: exactness at 
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steady state will no longer hold for all processes, but only for processes with no synchronization at all 
and processes whose synchronizations do not take place right before the sequences to be reduced. 

This paper is organized as follows. After introducing a Markovian process calculus in Sect. |2] and 
recalling strong and weak Markovian bisimilarity in Sect. [3l in Sect. |4] we develop a variant of weak 
Markovian bisimilarity that deals with parallel composition and we investigate its congruence and exact- 
ness properties. Finally, in Sect. |5] we provide some concluding remarks. 

2 Concurrent Markovian Processes 

In order to study properties such as congruence of the variant (to be defined) of the weak Markovian 
bisimilarity of |j3l, we introduce typical behavioral operators through a Markovian process calculus 
(MPC for short). In ||3l, we have considered sequential processes with abstraction built from opera- 
tors like the inactive process, exponentially timed action prefix, alternative composition, recursion, and 
hiding. Here, we include parallel composition too, so as to be able to represent concurrent processes. 

As usual, we denote the internal action by T and we assume that the resulting concurrent processes 
are governed by the race policy: if several exponentially timed actions are simultaneously enabled, the 
action that is executed is the one sampling the least duration. We also assume that the duration of an 
action deriving from the synchronization of two exponentially timed actions is exponentially distributed 
with a rate obtained by applying (like, e.g., in lITOll ) some commutative and associative operation denoted 
by (S" to the rates of the two original actions. 

Definition 2.1 Let Actu = Name x M>o be a set of actions, where Name = Name^ U {f} is a set of action 
names - ranged over hy a,b - and M>o is a set of action rates - ranged over by A,;U,7. Let Var be a set 
of process variables ranged over by X,Y. The process language is generated by the following 

syntax: 



P ::= 


inactive process 


<a,X>.P 


exponentially timed action prefix 


P + P 


alternative composition 


X 


process variable 


recX:P 


recursion 


P/H 


hiding 


1 PWsP 


parallel composition 



where a € Name, X G M>o, X G Var, and H,S CI Name^. We denote by Pm the set of closed and guarded 
process terms of - ranged over by P, Q. ■ 

In order to distinguish between process terms such as <a, A > .0 + <a, A > .0 and <a, A > .0, like in lO 
the semantic model [[P]]m for a process term P G Pm is a labeled multi transition system that takes into 
account the multiplicity of each transition, intended as the number of different proofs for the transition 
derivation. The multi transition relation of [[/'Jm is contained in the smallest multiset of elements of Pm x 
Actu X Pm that satisfies the operational semantic rules in Table [T]- where {_ ^ _} denotes syntactical 
replacement - and keeps track of all the possible ways of deriving each of its transitions. 

3 Strong and Weak Markovian Bisimulation Equivalences 

The notion of strong bisimilarity for MPC is based on the comparison of exit rates lITTlfTOl . The exit rate 
of a process term P G Pm with respect to action name a G Name and destination D C Pm is the rate at 
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P{recX :P^X} — ^m^' 

(PREm) ^ (ReCm) 

<a,X>.P recX:P — '■ — ^m^' 

a, A a,X 
Pi >mP' , P2 '•M^' 

(AlTm,i) -1 (AlTm,: 



Pi +P2 >mP' Pi +P2 >mP' 

P "'^ ) mP' a^H P-—^mP' aeH 

(Hidm,i) ^ (HIDm,2) ^ 

P/H—^mP'/H P/H—^mP'/H 

, Pi—^mP[ aiS ^ Pi^^mPi a^S 

(PaRm,i) (PAR: ^ 



Pi\\sP2^^mP{\\sP2 ' Pi\\sP2—^mPi\\sP2 

a, A] a. At 

P\ >mPi P2 ^M^2 o£S 

(Synm) 



a,Ai(8iA2 
■Pi ||s-P2 ^M^i ||5-f2 



Table 1 : Structured operational semantic rules for MPC 



which P can execute actions of name a that lead to D: 

rate{P,a,D) = G M>o | 3P' e D.P ^^mP' \} 
where {| and |} are multiset delimiters and the summation is taken to be zero if its multiset is empty. 
By summing up the rates of all the actions of P, we obtain the total exit rate of P, i.e., ratex{P) = 
HaeName rate{P,a,FM), which is the reciprocal of the average sojourn time associated with P. 

Definition 3.1 An equivalence relation ^ over Pm is a Markovian bisimulation iff, whenever (A j^z) £ 
then for all action names a € Name and equivalence classes D G Pm/^: 

rate{Pi,a,D) = rate{P2,a,D) 
Markovian bisimilarity ~mb is the largest Markovian bisimulation. ■ 

As shown in ||IIl|l0l|6l|71, the relation ~mb possesses the following properties: 

• ~MB is a congruence with respect to all the operators of MPC as well as recursion. 

• ~MB has a sound and complete axiomatization whose basic laws are shown below: 





P1+P2 


= P2 + P1 


(=2413,2) 


{Pl+P2)+P3 


= Pl + {P2+Pi) 


(-2413,3) 


P + 


= P 


(=2413,4) 


<a,Xi>.P+<a,^.2>.P 


= <a,Xi+X2>.P 



The last one encodes the race policy and hence replaces the idempotency law P + P = P valid for 
nondeterministic processes. The other laws are the usual distribution laws for the hiding operator 
and the expansion law for the parallel composition operator. 



M. Bernardo 



125 



• ~MB induces a CTMC-level aggregation known as ordinary lumpability, which is exact both at 
steady state and at transient state. 

• ~MB can be decided in polynomial time for all finite-state processes. 

In [31, we have weakened the distinguishing power of ~]vib by relating sequences of exponentially 
timed T-actions to single exponentially timed T-actions having the same average duration and execution 

probability as the sequences. Given P £ Pm, we say that P is stable if P — / — >mP' for all X and P', 
otherwise we say that it is unstable. In the latter case, we say that P is fully unstable iff, whenever 

a, A 

P >mP', then a = T. We denote by PM.fu and Pjvi.nfu the sets of process terms of Pm that are fully 

unstable and not fully unstable, respectively. 

The most natural candidates as sequences of exponentially timed T-actions to abstract are those 
labeling computations that traverse fully unstable states. 

Definition 3.2 Let n € N>o and Pi,P2, • • • ,Pn+i € Pm- A computation c of length n from Pi to P„+i 

T,Ai '^,^2 ^^Ki 

having the form Pi >mP2 '^m • • • >MPn+i is reducible iff P,- G PmJu for all / = 1, . . . ■ 

If reducible, the computation c above can be reduced to a single exponentially timed T-transition whose 
rate is obtained from the positive real value below: 

probtimeic) = ( ft ,,,,(pt,,p^) ) • (.£ .,.,(,.'.,p^) ) 

by leaving its first factor unchanged and taking the reciprocal of the second one. The value probtime{c) 
is a measure of the execution probability of c (first factor: product of the execution probabilities of the 
transitions of c) and the average duration of c (second factor: sum of the average sojourn times in the 
states traversed by c). 

The weak variant of ~mb defined in |]3l is such that (i) processes in PM,nfu are dealt with as in ~mb 
and (ii) the length of reducible computations from processes in PM.fu to processes in PM.nfu is abstracted 
away while preserving the execution probability and the average duration of those computations. In 
the latter case, we need to lift measure probtime from individual reducible computations to multisets 
of reducible computations. Denoting by reducomp{P,D,t) the multiset of reducible computations from 
P € I^Miu to some P' in D C Pm whose average duration is ? € M>o, we consider the following f-indexed 
multiset of sums of probtime measures: 

pbtm{P,D) = U {| L probtime {c)W 

reK>0 s.t. reducomp{P,D,t)^<d cereducomp(P,D,t) 

Definition 3.3 An equivalence relation ^ C (PM,nfu x I^M.nfu) U (PM,fu x ^M,tu) is a weak Markovian 
bisimulation iff for all (Pi,P2) G ^: 

• If Pi ,P2 G PM,nfu, then for all a G Name and equivalence classes D G ¥m/^' 

rate(P\,a,D) = rate{P2,a,D) 

• If Pi ,P2 G PM,fu> then for all equivalence classes D G PM,nfu/"^: 

pbtm{Pi,D) = pbtm{P2,D) 

Weak Markovian bisimilarity ~mb is the largest weak Markovian bisimulation. ■ 

Example 3.4 Typical cases of weakly Markovian bisimilar process terms are: 
<T,jU>.<T,7>.(2 <T,Y>.<r,^>.Q <T,^>.(2 

and: 
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<T,H>.{<r,Yi>.Qi + <r,Y2>-Q2) ^ 

and: 

<r,i^i>.<r,Y>.Qi + <r,H2><r,r>-Q2 

• + >-Q^ + ^ • (]iiT]i7 + '> Q2 

where Q,Qi,Q2^ IPivi.nfu (see [3 1 for the details). ■ 

Similar to weak bisimilarity for nondeterministic processes, ^mb is not a congruence with respect to 
the alternative composition operator. This problem, which has to do with fully unstable process terms, 
can be prevented by adopting a construction analogous to the one used in lfT3l for weak bisimilarity over 
nondeterministic process terms. In other words, we have to apply the exit rate equality check also to fully 
unstable process terms, with the equivalence classes to consider being the ones with respect to ~mb- 

Definition 3.5 Let Pi,P2 € Pm- We say that Pi is weakly Markovian bisimulation congruent to Pj, 
written Pi ~]yiB P2, iff for all action names a G Name and equivalence classes D € Pm/ ~mb: 

rate{Pi,a,D) = rate{P2,a,D) _ 

As shown in [3], the relation ~mb possesses the following properties: 

• —MB is the coarsest congruence - with respect to all the operators of MPC other than parallel 
composition, as well as recursion - contained in ~mb- 

• —MB has a sound and complete axiomatization over the set of sequential process terms (i.e., pro- 
cess terms with no occurrences of the parallel composition operator), whose basic laws are those 
of ~mb plus the following one (which includes the various cases shown in Ex. 13.411 : 

(=24iB,5) <a,X>-L<T:,l^i>- L<T:,7ij>-Pij = 

iei jeJi 1 

<«,A>.I ^<T,f.'f.U + i) >.P,j 

iel jeJj ^ ' 

where / / is a finite index set, 7,- / is a finite index set for all iel, IJ. = l^i^ ^i^d 7 = I^yey, YiJ 
for all / G /. 

• —MB induces a CTMC-level aggregation called W-lumpability, which is exact only at steady state 
and performs reductions consistent with £/mb,5- Moreover, ~mb preserves transient properties 
expressed in terms of the mean time to certain events. 

• —MB can be decided in polynomial time only for those finite-state processes that are not divergent, 
i.e., that have no cycles of exponentially timed T-transitions. 

4 Compositionality for Concurrent Processes 

The relation ~mb is not a congruence with respect to the parallel composition operator, thus restricting 
the usefulness for compositional state space reduction purposes of the framework developed in |[3|. 

Example 4.1 Assuming parallel composition to have lower priority than any other operator, it holds that: 

<a,A>.<T,jU>.<T,7>.0 ~MB <a,A>.<T,^>.0 

while: 

<a,A>.<T,/i>.<T,7>.O||0<fl'',A'>.O 9^MB <a,A>.<T,^>.O||0<a',A'>.O 
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First of all, we note that: 

<T,/i>.<T,7>.O||0<fl'',A'>.O ^MB <T,-^>.O||0<a',A'>.O 
In fact, for d ^ z the two process terms are not fully unstable with: 

rate(<T,/i>.<T,7>.O||0<a',A'>.O,T,[<T,7>.O||0<a'',A'>.O]~^3) = \l 
raf£'(<T,^>.O||0<£?',A'>.O,T,[<T,7>.Oi|0<a',A'>.O]«^B) = 
On the other hand, for d = z the two process terms are fully unstable with: 

/^ftM<T,At>-<T,7>-O||0<a',A'>.O,[O||0O]«^J = {| • ^) • + ^ + 

{ M A' W 1 I 1 I 1\ 

V^j+A' 7+X'/ V^I+I' "T ^ 7/' 

(]I+f) ■ (/I+F + ]I + 7) 1} 

p&fm(<T,i^^>-O||0<a',A'>.O,[O||0O]^^3) = {| (^g^) • ( 1, + 

1 I 1 



) ■ ( M I V + w) 1} 



[<T,At>.<T,7>.Oi|0<a',A'>.O]^^3n[<T,^>.O||0<a',A'>.O]^^3 = 



Thus: 
and hence: 

rate(<a,A>.<T,;U>.<T,7>.O||0<a',A'>.O,a, [<T,/i>.<T,7>.O||0<a',A'>.O]~^3) = A 
whereas: 

rate(<a,A>.<T,^>.O||0<a',A'>.O,a,[<T,At>.<T,7>.Oi|0<a',A'>.O]«^B) = 
Also the two divergent process terms recX : <T,/i>.<T,7i>.X and recX : <T,/i>.<T, 72>.X, 71 7^ 72, 
are related by ~mb but this no longer holds when placing them in the context _ <a', A'>.0, a' ^T. ■ 

Taking inspiration from the weak isomorphism of ifTTI . in this section we show how to retrieve full 
compositionality by enhancing the abstraction capability of ~mb in the case of concurrent computations. 
The price to pay is that exactness will hold at steady state only for a certain class of processes. 



4.1 Revising Weak Markovian Bisimilarity 

As we have seen, and ~mb abstract from sequences of exponentially timed T-actions while preserv- 
ing (at the computation level) their execution probability and average duration and (at the system level) 
transient properties expressed in terms of the mean time to certain events as well as steady-state perfor- 
mance measures. This kind of abstraction has been done in the simplest possible case: sequences of 
exponentially timed T-actions labeling computations that traverse yw/Zy unstable states. 

In order to achieve compositionality when dealing with concurrent processes, a revision of the notion 
of reducible computation is unavoidable. More precisely, we need to address the case of sequences 
of exponentially timed T-actions labeling computations that traverse unstable states satisfying certain 
conditions. The reason is that, if we view a system description as the parallel composition of several 
sequential processes, any of those processes may have local computations traversing fully unstable local 
states, but in the overall system those local states may be part of global states that are not fully unstable. 

For instance, this is the case with the process <T,/i>.<T, 7>.0 II0 <a, A>.0, whose underlying la- 
beled multitransition system is depicted below on the left: 

■^l.l X,\i ■^1,2 T,Y-, '^1,3 '^2,1 T,H-Y/(|I+Y) '^2,2 

'', a, a^X\ ^ ' ^ ^ 

■Sl,4 1:,^ .^LS t.Y yi,6 ■^2,3 T,^-Y/(H+Y) .S2,4 

As can be noted, the fully unstable local states traversed by the only local computation of the sequential 
process <t,/x>.<t, 7>.0 may become part of unstable global states that are not fully unstable if a 7^ T. 



128 



Weak Markovian Bisimulation Congruences and Exact CTMC-Level Aggregations 



Our objective is to change the notion of reducible computation in such a way that the labeled multitransi- 
tion system on the left can be regarded as being weakly Markovian bisimilar to the labeled multitransition 
system on the right. As can be noted, this implies that execution probabilities and average durations can 
only be preserved at the level of local computations, hence transient properties expressed in terms of the 
mean time to certain events can no longer be preserved at the system level. 

In a concurrent setting, a sequence of exponentially timed T-actions may be replicated due to inter- 
leaving, in the sense that it may label several computations that share no transition. The revision of the 
notion of reducible computation is thus based on the idea that, for each computation that traverses fully 
unstable local states and is labeled with exponentially timed T-actions, we have to recognize - and take 
into account at once - all the replicas of that computation and pinpoint their initial and final states. In 
our example, there are two replicas with initial states si i and si 4 and final states 5'i 3 and si^. 

In general, a one-to-one correspondence can be established between the states traversed by any two 
replicas by following the direction of the transitions. In our example, the pairs of corresponding states are 
the two initial states (51,1,51,4), the two intermediate states (5i,2)5i,5), and the two final states (51,3,51 g). 
We can say that when moving vertically the current stage of the replicas is preserved. 

In addition to the exponentially timed T-transition belonging to the replica, any two states traversed 
by the same replica can only possess transitions that are pairwise identically labeled. Those transitions 
are originated from (the local states of) sequential processes that are in parallel with (the local state of) 
the sequential process originating the considered reducible computation. The set of those transitions not 
belonging to the replica can thus be viewed as the context of the replica. In our example, the context of 
the top replica has a single transition labeled with <«, A>, whereas the context of the bottom replica is 
empty. Thus, when moving horizontally the context of each replica is preserved, i.e., the context does 
not change along a replica. On the other hand, different replicas may have different contexts. 

With regard to the identification of the boundary of the replicas of a reducible computation, there are 
two possibilities. One is that the final states have no exponentially timed T-transition, as in our example. 
The other is that, at a certain point, each replica has an exponentially timed T-transition back to one of 
the preceding states of the replica itself, as shown below with a variant of our example: 

T,Y \ t,h-y/(^+y) 



\ a, X 



%y \ 1:, |j.-y/(m.+y) 

In this case, for each replica we view its return state as being its final state. In the figure above, for both 
replicas the final state coincides with the initial state. 

The new notion of replicated reducible computation must be accompanied by an adjustment of the 
way measure probtime and multiset pbtm are calculated. Given a computation c of the form 

T,Ai T,A2 "^.^n 

Pi >mP2 • • • >MPn+i that is reducible in the sense of Def. 13.21 the denominator of 

the /-th fraction occurring in each of the two factors of probtime (c) can indifferently be ra?e (Z^-, t,Pm) 
or ratet{Pi): those two values coincide because P,- € IPm iu for all / = 1, . . . ,n. In contrast, if the reducible 
computation c is replicated, each of its replicas has a possibly different context and it is fundamental 
that rate{Pi, TjFm) values are taken as denominators, so as to focus on T-transitions. Since there can be 
T-transitions also in the context, each destination of those exit rates needs to be a specific set ^ con- 
taining only the states traversed by the replicas rather than the generic set Pm- Taking into account only 
T-transitions leading to states in J!^ ensures context independence in this concurrent setting, which opens 
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the way to the achievement of the same probtime value for all the repUcas of a reducible computation. 

We are by now ready to provide the definition of replicated reducible computation together with the 
revision of both probtime and pbtrn. Since several reducible computations can depart from the same 
state (see the second and the third pair of process terms of Ex. I3.4I ). in general we will have to handle 
replicated trees of reducible computations rather than replicated individual reducible computations. 

In the sequel, we consider m G N>o process terms Pi,P2, . . . ,P,n € Pm different from each other. We 

ak-Xk 

suppose that Pk ^•m^*:+i for all A; = 1, ... ,ni — 1, with P^ having a nonempty tree of computations 

that are locally reducible for all A; = 1, . . . ,m (see sij and ^ in our example). This tree is formalized as 
the set of all the finite-length computations starting from /\ such that each of them (i) is labeled with a 
sequence of exponentially timed T-actions, (ii) traverses states that are all different with the possible ex- 
ception of the final state and one of its preceding states, and (iii) shares no transitions with computations 
in Cl for all k' / k. 

We further suppose that the union of CpC2 , • • • can be partitioned into n G N>() groups of replicas 
each consisting of m computations from all the m sets, such that all the computations in the same group 
have the same length and are labeled with the same sequence of exponentially timed T-actions. As a 
consequence, for all ^ = 1 , . . . , m we can write: 

T.A,-,i T,A,-2 l','^!./,- 

Cl = {Ck.i = Pkj,\ >MPk,i,2 >M ■ ■ ■ >MPk,iJi+l I 1 < i < «} 

where Pj. i = /\ is the initial state and G N>o is the length of the computation for all / = l,...,n. 

Definition 4.2 The family of computations = {CpCj , . . . ,C,y,} is said to be generally reducible, or 
g-reducible for short, iff either m = 1 and for all / = l,...,n: 

• Pij.j e IPM,fu for all 7 = 1 , ... , If, 

• PijJi+i e PM.nfu or Pijj,+i = Pi,ij for some j=\,...,li; 

OT m > 1, with Pij j € Pivi.nfu for all / = 1, . . . ,« and 7 = 1,...,/; when m= I, and for all / = 1, . . . 

• For all k = \ m, j = I,..., li, and <a,X > € Actu- 

1. [Deviation from the replica] If P/t j-y ^m^' with P' ^ Pk.ij+i, then: 

a. [change of replica via context] either P' = Pk'jj for some k' = I,... ,m; 

b. [change of computation] or P' = Pkj'j' with a = z and A = ^i'j'-i for some i' = l,...,n 
other than / and some / = 2, . . . , 

2. [Context preservation along the replica] For all A;' = 1 , . . . , m, it holds that Pkj.j ^-m Pk',i,j 

a,X 

iff Pk,i,j' >MPk',i,j' for all / = 1, . . . ,Z,-. 

3. [Stage preservation across replicas] For all /' = l,...,?i other than / and / = 2, . . . ,Z,/+i, 

a.X a.X 

it holds that Pk^ij — — >MPk.i'.j' iff Pk'jj — — >MPk',i',j' for allk' = I,... ,m. 

• [Termination] One of the following holds: 

4. Whenever there exists G M>o such that Pt.i.i^+i >MPk,i.ii+2 for all ^ = 1 , . . . , m, then 

at least one of conditions 1, 2, and 3 above is not satisfied by Pk'.i.ij+i for some k' = I, . . . ,m. 

4. There is no Xtj.^i £ M>o such that Pkjji+i >MPk.i.ii+2 ior all k = I, . . . ,m. 

4- Pk.i.ii+\ = Pk,i.j for all ^ = 1 , . . . , m and some 7 = 1,...,/,-. H 
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Some comments are now in order: 

• In the case that m = I and all the traversed states are fully unstable (see the "either" option), 
Def. l4.2l coincides with Def. l3.2l except for the fact that the former considers a tree of computations 
whilst the latter considers a single computation. 

• The case m = 1 with Pijj € Pivi.nfu for every / = 1, . . . ,« and j = happens when all the 
sequential process terms in parallel with the one originating the tree of locally reducible computa- 
tions repeatedly execute a single action (selfloop transition), thus causing no replica of the tree to 
be formed. Both this case and the case m > 2 are subject to conditions 1, 2, 3, and 4. 

• Condition 1 establishes that each transition deviating (see P' ^ Pk.i.j+\) from the replica of the 
considered computation of 

- either is a vertical transition of the context that preserves the current stage of the replicas and 
hence causes the passage to the corresponding state of another replica {k' ^ k) or to the same 
state of the same replica {k' = k, meaning that one of the sequential process terms in parallel 
with the one originating the considered computation repeatedly executes a single action); 

- or is a transition belonging to some other computation in starting from the same process 
term Pk as the considered computation. 

These two facts together imply the maximality of because taking into account deviating transi- 
tions causes all replicas to be included. In addition, they prevent process terms like 
<T,/i>.(<T,7>.0 + <a,A>.0) + <a,A>.0 and <T, ■^>.0 + <a, A>.0 - which do not con- 
tain occurrences of parallel composition (m = 1) and have no fully unstable states when a ^ z - 
from being deemed to be equivalent. 

• Condition 2 is related to condition l.a and ensures that the context of a replica is preserved along 
each state traversed by the replica. 

• Condition 3 is related to condition l.b and ensures that any transition belonging neither to the 
considered computation nor to its context (i.e., belonging to some other computation in '^^) is 
present at the same stage of each replica of the considered computation. 

• The three variants of condition 4 establish the boundary of the replicas of the considered com- 
putation in a way that guarantees the maximality of the length of the replicas themselves under 
(i) conditions 1, 2, and 3, (ii) the constraint that all of their transitions are labeled with exponen- 
tially timed T-actions, (iii) and the constraint that all the traversed states are different with the 
possible exception of the final state and one of its preceding states. 

Let initial{^'^) = {Pk \ l <k<m} and final{^'^) = | 1 < /c < m, 1 < / < «} be the sets 

of initial states and final states of the computations in In order to avoid interferences between the 
computations in Cl,Cl, ... and the transitions belonging to the context of those computations, for 
any computation c^j in we consider the following context-free measure: 



where = {Pk.i'.f I 1 < < '^,2 < / < In this way, all replicas of the same computation will 

have the same probtime^^ measure, as shown below. 

Proposition 4.3 Whenever is g-reducible, then for ail k,k' = I, ... ,m and i = I, . . . ,n: 




probtime^.f{ckj) = probtime^.f{ck'j) 
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Moreover, we replace the generic multiset pbtm{P,D) with the more specific multisets pbtm^.f{Pk,Dr\ 
final{'io'^)) for all /\ € initial{^'^). The latter multisets are based on probtime^^ instead of probtime 
as well as on reducomp^f instead of reducomp, where reducomp^f{Pk,D r\final{'i^'^),t) is the multi- 
set of computations identical to those in that go from to D r\final{'io'^) and have average dura- 
tion t. We point out that computations of length zero are not considered as f G M>o, so that whenever 
Pyt G initial{'^'^)r\Dr\final{'i9'^), then the calculation of pbtm^.f{Pi^,D r\final{'i§"^)) does take into account 
computations identical to those in going from /\ to itself. 

Proposition 4.4 Whenever is g-reducible, then for all k,k' = I, ... ,m: 

pbtm^f{Pk,final{'W^)) = pbtm^{{Pk' ,final{'^'^)) ■ 

We are finally ready to introduce the revised definition of weak Markovian bisimilarity. 

Definition 4.5 An equivalence relation =^ over Pm is a g-weak Markovian bisimulation iff, whenever 
{Pi, Pi) G-^, then: 

• For all visible action names a G Name^ and equivalence classes D G Pm/^: 

rate{Pi,a,D) = rate{P2,a,D) 

• If Pi is not an initial state of any g-reducible family of computations, then P2 is not an initial state 
of any g-reducible family of computations either, and for all equivalence classes D G Fm/^'- 

rate{Pi,x,D) = rate{P2,r,D) 

• If Pi is an initial state of some g-reducible family of computations, then P2 is an initial state of 
some g-reducible family of computations too, and for all g-reducible families of computations 'tf^ 
with Pi G initial{^^) there exists a g-reducible family of computations 'I02 with P2 G initial {'1^2) 
such that for all equivalence classes D G Fm/^'- 

pbtm^fiPuD nfinal(y^)) = pbtm^f{P2,D DfinalC^^)) 

G-weak Markovian bisimilarity ~]viB,g is the largest g-weak Markovian bisimulation. H 

Example 4.6 The process terms mentioned in each of the three cases of Ex. [34l are still related by ~MB,g- 
Note that each of those process terms is the only initial state of a g-reducible family of computations 
composed by a single computation (first case) or a single tree of computations (second and third case) 
traversing only fully unstable states, thus m = 1 and the "either" option of Def. [42] applies. ■ 

Example 4.7 Let us reconsider the two process terms at the beginning of Ex. 14. 1[ Now we have: 
<£Z,A>.<T,;U>.<T,7>.0 ^MB,g <a,A>.<T,^>.0 

and: 

<a,A>.<T,/x>.<T,7>.O||0<a',A'>.O ^MB,g <fl',A>.<T,^>.O||0<a',A'>.O 
because it holds that: 

<T,At>.<T,7>.O||0<a',A'>.O «MB,g <T,^>-O||0<a',A'>.O 
In fact, for d ^ % the two process terms are the initial states of two g-reducible families of computations 
'^l and ^2^, respectively, each composed of two replicas - the first one having context {<£?', A'>} and 
final state 1 1 < a' , A '> .0 and the second one having empty context and final state 1 1 - with : 
pZ7fra,f(<T,At>.<T,7>.O||0<a',A'>.O,Dn>a/(<ri^)) = {| ^ + j |} 
pZ7fmrf(<T,i^>.O||0<a',A'>.O,Dn>a/Cr/)) = {| ^ |} 
whenever D contains the final state He <a', A'>.0, as the way of calculating probtime ^.f and pbtm^f does 
not take the context into account. 
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For a' = T, in addition to 'if^ and "^2^, the two process terms are the initial states of two further g-reducible 
families of computations and '^2^' respectively, each composed of two replicas of length 1 labeled 
with <a', A'>. In this case: 

pbtm^f{<r,IX>.<T,Y>.0\\s,<a',X'>.0,Dnfinal{'Tfl'')) = {\jr\} 

pbtm,t{<T,f^^>.0\U<a',X'>.0,Dnfinal{'^^)) = {\{r\} 
whenever £) contains the two pa^B g-equivalent final states <t,/x>.<t, 7>.0 HgO and <T, ^^>.0 HbO. 
The two divergent process terms at the end of Ex. 14. 1 1 are not related by ~MB,g because 71 7^ 72; hence, 
they no longer result in a disruption of compositionality when placed in the context _ Ha <a', A'>.0. ■ 

We conclude by showing that there exists a relationship between ~MB,g and ^mb only for process 
terms that have no cycles of exponentially timed T-actions. The reason of this limitation is that ~MB,g 
imposes checks on those cycles that are not always performed by ~mb. like, e.g., in the case of the two 
divergent process terms recX : <t, Yi>.X and recX : <t, J2>-X where 71 7^ 72. 

Proposition 4.8 Let P\,P2^ Fm be not divergent. Then: 

P\ ~MB Pi =^ Pi ~MB,g Pi ■ 



4.2 Congruence Property 

The investigation of the compositionality of ~MB,g with respect to MPC operators leads to results analo- 
gous to those for 151, plus the achievement of congruence with respect to parallel composition. 

Proposition 4.9 Let Pi,/'2 G Pm- Whenever Pi ^uB.g Pi, then: 

1. <a,X>.Pi ?a]y[g g <a, A>./'2 for all <<3, A> SAcfM- 

2. Pi /H R^MB.g Pi/H for all H C Name^. 

3. Pi lIsP ssMB,g Pi WsP and PjlsA T^^M&.g P \\sPi for all S C Name^ and P G Pm- ■ 

The relation ~MB,g is not a congruence with respect to the alternative composition operator due to 
fully unstable process terms: for instance, it holds that <t,/x>.<t, 7>.0 «MB,g <^)]rt^>-0 whereas 
<T,/i>.<T,7>.0 + <<3,A>.0 i^MB.g <T, ^21^>.0 + <a,A>.0. In fact, if it were a / T, then we would 
have: 

raff'(<T,At>.<T,7>.0 + <a,A>.0,T,[0]«^B J = 
ra?^'(<T,i^>.0 + <a,A>.0,T,[0].^3j = 
otherwise for a = T the two process terms would be the initial states of two g-reducible families of com- 
putations, respectively, each composed of a single tree of computations with final state and we would 
have: 

pbtm,,{<T,^i>.<T,y>.Q + <a,X>.um = {l]i^-(7rTi + -0'7iTi-7iTxl} 

pbtm,f{<z,-^>.0 + <a,X>.0,{0}) = {|^^|} 

The congruence violation with respect to the alternative composition operator can be prevented by 
adopting a construction analogous to the one used in lfT3l for weak bisimilarity over nondeterministic 
process terms and adapted in |3| to ~mb- Therefore, we have to apply the exit rate equality check for 
T-actions also to process terms that are initial states of g-reducible famihes of computations, with the 
equivalence classes to consider being the ones with respect to ~MB.g- 

Definition 4.10 Let Pi,P2 G Pm- We say that Pi is g-weakly Markovian bisimulation congruent to P2, 
written Pi ~MB,g Pi, iff for all action names a G Name and equivalence classes D G Pm/ ~MB,g: 

rate{Pi,a,D) = rate{P2,a,D) ■ 
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Proposition 4.11 ~mb C — MB,g C ~MB,g, with ^MB,g = ~MB,g over the set of process terms of Pm that 
are not initial states of any g-reducible family of computations. H 

Proposition 4.12 Let/'i,/2 G and <a,X> GActu- Then: 

<a,X>.Pi ~MB,g <a,k>.P2 Pi ~MB,g Pi m 

The relation ^MB,g turns out to be the coarsest congruence - with respect to all the operators of MPC 
as well as recursion - contained in ~MB,g> as shown below. 

Theorem 4.13 Let Pi,P2£Fm- Whenever Pi ~MB,g Pi, then: 

1. <a,X>.Pi ~MB,g <'3,'^>-^2 for all <<3, A> GActu- 

2. Pi+P ~MB,g Pi + P and P + A ~MB,g P + Pi for all P G Pm- 

3. Pi/H ~MB,g Pi/H for all H C Name^. 

4. Pi WsP ~MB,g Pi WsP and P||sPi ~MB,g P \\sPi for all S C Name^ and P G Pm- ■ 
Theorem 4.14 Let Pi , P2 G Pm- Then Pi ~MB,g Pi iff P\+P ~MB,g Pi + P for all P G Pm- ■ 

With regard to recursion, we need to extend ~MB.g to open process terms in the usual way. Similar to 
other congruence proofs for bisimulation equivalence with respect to recursion, here we rely on a notion 
of g-weak Markovian bisimulation up to ~MB,g inspired by the notion of Markovian bisimulation up to 
~MB of [SJ. This notion differs from its nondeterministic counterpart used in 1,13,1 due to the necessity of 
working with equivalence classes in this Markovian setting. 

Definition 4.15 Let Pi ,P2 G be process terms containing free occurrences of G N process vari- 

ables Xi,...,Xke Var at most. We define Pi ^MB,g Pi iff Pi{Qi ^Xi\ \ <i<k} ~MB.g Pi{Qi ^ Xi \ 
I <i <k} for all 2i , . . . , G containing no free occurrences of process variables. H 

Definition 4.16 Let + denote the operation of transitive closure for relations. A binary relation ^ 
over Pm is a g-weak Markovian bisimulation up to ~MB,g iff> whenever (Pi,P2) G then: 

• For all visible action names a G Name^ and equivalence classes D G Pm/ U =^^'u ~MB,g)^: 

rate{P\,a,D) = rate{P2,a,D) 

• If Pi is not an initial state of any g-reducible family of computations, then P2 is not 
an initial state of any g-reducible family of computations either, and for all equivalence classes 
DGPM/(^U^-iu«iMB,g)+: 

rate{Pi,r,D) = rate(P2,T,D) 

• If Pi is an initial state of some g-reducible family of computations, then P2 is an initial state of 
some g-reducible family of computations too, and for all g-reducible families of computations 
with Pi G initial{^^) there exists a g-reducible family of computations with P2 G initial{'i^2) 
such that for all equivalence classes D G Pm/ U =^^'u ~MB,g)^- 

pbtm^f{Pi,Dnfinal{'^^)) = pbtm^^{P2,Dnfinal{'^^)) ■ 

Proposition 4.17 Let ^ be a relation over Pm. If =^ is a g-weak Markovian bisimulation up to ~MB,g> 
then (Pi ,P2) G ^ implies Pi ^m^.g Pi for all Pi ,P2 G Pm- Moreover U ^"'u ~MB,g)+ = ~MB,g- ■ 

Theorem 4.18 Let Pi,P2 G ^^^m be process terms containing free occurrences of G N process vari- 
ables Xi, . . . ,X/; G Var at most. Whenever Pi ~MB,g Pi, then: 

recXi : . . . : recX^ : Pi ^^^MB.g r&cX\ : ... : recX^ : P2 H 
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4.3 Exactness at Steady State 

We conclude by examining the exactness of the CTMC-level aggregation induced by ~MB,g and ^^^MB.g- 
In general, a CTMC aggregation is said to be exact at steady state (resp. transient state) iff the steady-state 
(resp. transient) probability of being in a macrostate of an aggregated CTMC is the sum of the steady- 
state (resp. transient) probabilities of being in each of the constituent microstates of the original CTMC 
from which the aggregated one has been obtained. This property implies the preservation of steady-state 
(resp. transient) reward-based performance measures across CTMC models. 

The aggregation to examine - which we call GW-lumpability - shares with the one induced by ^mb 
and ~]viB - called W-lumpability in - the characteristic of viewing certain sequences of exponentially 
timed T-actions to be equivalent to individual exponentially timed T-actions having the same average du- 
ration and the same execution probability as the corresponding sequences when the latter are considered 
locally to the processes originating themQ On the other hand, due to the idea of context embodied in the 
notion of g-reducible family of computations and the consequent capability of distinguishing between ac- 
tion disabling and action interruption, a notable difference between GW-lumpability and W-lumpability 
is that the former may aggregate states also in the case of concurrent processes, while the latter cannot. 

Reducing a computation formed by at least two exponentially timed T-transitions to a single expo- 
nentially timed T-transition with the same average duration amounts to approximating a hypoexponen- 
tially (or Erlang) distributed random variable with an exponentially distributed random variable having 
the same expected value. This implies that, in general, GW-lumpability cannot preserve transient per- 
formance measures, as was the case with W-lumpability |t3|. However, while W-lumpability at least 
preserves transient properties expressed in terms of the mean time to certain events, this is no longer the 
case with GW-lumpability as we have seen at the beginning of Sect. 14.11 

What turns out for GW-lumpability is that, similar to W-lumpability, it preserves steady-state per- 
formance measures, provided that the states traversed by any replica of a reducible computation have 
the same rewards and the transitions - belonging to the replica or to the context - departing from any 
two traversed states have pairwise identical rewards. However, unlike W-lumpability, we have to confine 
ourselves to processes in which synchronizations (if any) do not take place right before the beginning of 
computations that are reducible according to the "or" option of Def. 14.21 This constraint comes from the 
insensitivity conditions for generalized semi-Markov processes mentioned in [|l2l [8l[Tn. 

Theorem 4.19 GW-lumpability is exact at steady state over every process term P G Pm such that, for all 
g-reducible families of computations in [[P]]m with size m > 2, or size m = I and all the traversed 
states being not fully unstable, no state in initial{'^'') is the target state of a transition in [[P]]m arising 
from the synchronization of two or more actions. ■ 

Example 4.20 In order to illustrate the need for the constraint on synchronizations in Thm. 14.191 con- 
sider the following two process terms: 

Pi = recX : <t,/i>.<t,7>.<Zj,5>.X ||ji,}recy : <a,A>.<Z>,5>.F 
P2 = recX : <T,-^>.<ft,5>.X ||{^}recy : <a,A>.<Z7,5>.F 
Observe that P\ ~MB,g Pi and that [[AEm and \P2^m are given by the two labeled multi transition systems 
depicted at the beginning of Sect. 14.11 respectively, with an additional transition labeled with <b,5> 
from the final state to the initial one. In the case that /x = 7= A = 5 = l and 5® 5 = 5, it turns out that 
the steady-state probability distribution for [[Pi]]m is as follows: 

' To be precise, since the Markov property of tiie original CTMC is not preserved but the aggregated stochastic process is 
still assumed to be a CTMC, it would be more appropriate to call those aggregations pseudo-aggregations 1141 . 
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^[sia] = Ti ^[^1,5] = T3 ^[^1,6] = T3 

whereas the steady-state probability distribution for [[P2IM is as follows: 

?r[^2,l] = Jo ^[^2,2] = To 

^[S2,3] = Jo ^[s2a] = Jo 

Thus, the CTMC underlying [[P2IM is not an exact aggregation of the CTMC underlying [[AJm because: 
n[si,i] + n[si2] / 7r[52,i] ^[^1.3] / ^^[^2,2] 

As can be noted, the transition in [[Pi]]m labeled with <b,d> arises from the synchronization of two 
Z?-actions and its target state is the initial state of a computation belonging to a g-reducible family with 
size m = 2; hence, Thm. 14. 191 does not apply. 

In contrast, if we consider a synchronization-free variant of the two process terms above like for 
instance: 

P3 = recX : <r,n>.<r,Y>-<b[,5i>.X\\i^recY : <a,X>.<b2,52>.Y 
P4 = recX : <r,-^>.<bi,di>.X\\QTecY : <a,?i>.<b2,52>.Y 
we have that for/i = 7 = A = 5i = 52 = l the steady-state probability distribution for ^Ps^m is: 
^[■^3,1] = 5 ?r[^3,2] = 5 ?r[^3,3] = 5 

^[■^3,4] = 5 ?r[53,5] = 5 7r[53,6] = 5 

and the steady-state probability distribution for [[/'4JM is: 

^[^4,1] = i 71[S4,2] = 5 

^[■^4,3] = i ^^4,4] = I 

hence the CTMC underlying [[AEm is an exact aggregation of the CTMC underlying [[PsJm because: 

71[s3,i]+k[st,2] = ^[S4,l] ^[■^3,3] = 7t[s4^2] 

7r[53,4] +7r[53,5] = ^[S4.3] ^[^3,6] = 7t[s4A] U 



5 Conclusion 

In this paper, we have introduced ~MB,g and ^MB.g as variants of the weak Markovian bisimulation 
equivalences ^mb and ~mb proposed in [31, which suffer from a limited usefulness for state space re- 
duction purposes as they are not congruences with respect to the parallel composition operator. The 
motivation behind ~MB.g and ~MB,g is thus that of retrieving full compositionality. Taking inspiration 
from the idea of preserving the context of 111], this has been achieved by enhancing the abstraction ca- 
pability - with respect to ^mb and ~mb - when dealing with concurrent computations. The price to pay 
for the resulting compositional abstraction capability is that the exactness at steady state of the induced 
CTMC-level aggregation does not hold for all the considered processes - as it was for ~mb and ~mb - 
but only for sequential processes with abstraction and concurrent processes whose synchronizations do 
not take place right before the beginning of computations to be reduced. Additionally, not even transient 
properties expressed in terms of the mean time to certain events are preserved in general. 

With regard to [11], where weak isomorphism has been studied, our equivalences ~MB,g and — MB,g 
have been developed in the more liberal bisimulation framework. A more important novelty with respect 
to weak isomorphism is that we have considered not only individual sequences of exponentially timed 
T-actions. In fact, we have addressed trees of exponentially timed T-actions and we have established the 
conditions under which such trees can be reduced - also in the presence of parallel composition - by 
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locally preserving both the average duration and the execution probability of their branches. 

Another approach to abstracting from T-actions in an exponentially timed setting comes from Bl . 
where a variant of Markovian bisimilarity was defined that checks for exit rate equality with respect to 
all equivalence classes apart from the one including the processes under examination. Congruence and 
axiomatization results were provided for the proposed equivalence, and a logical characterization based 
on CSL was illustrated in [2]. However, unlike ~MB,g and — MB,g. nothing was said about exactness. 

As far as future work is concerned, we would like to investigate equational and logical characteri- 
zations of — MB,g as well as conduct case studies for assessing its usefulness in practice (especially with 
respect to the constraint on synchronizations that guarantees steady-state exactness). With regard to 
verification issues, since ~mb C — MB,g for non-divergent process terms, we have that the equivalence 
checking algorithm developed for ~]y[B in [3] can be exploited for compositional state space reduction 
with respect to ~MB,g> by applying it to each of the sequential processes composed in parallel. 

Acknowledgment: This work has been funded by MIUR-PRIN project PaCo - Performability-Aware 
Computing: Logics, Models, and Languages. 

References 

[1] A. Aldini, M. Bernardo, and F. Corradini, "A Process Algebraic Approach to Software Architecture De- 
sign", Springer, 2010, doi: 10.1007/978-1-84800-223-4 

[2] C. Baler, J. -P. Katoen, H. Hermanns, and V. Wolf, "Comparative Branching-Time Semantics for Markov 
Chains", in Information and Computation 200:149-214, 2005, doi: 10.1016/j.ic.2005.03.001 

[3] M. Bernardo, "Weak Markovian Bisimulation Congruences and Exact CTMC-Level Aggregations for Se- 
quential Processes" , inProc. of TGC 2011, LNCS 7173:89-103. 

[4] M. Bravetti, "Revisiting Interactive Markov Chains", in Proc. of MTCS 2002, ENTCS 68(5): 1-20, 
doi: 1 0. 1 1 6/S 1 57 1 -066 1 (04)80520-6 

[5] M. Bravetti, M. Bernardo, and R. Gorrieri, "A Note on the Congruence Proof for Recursion in Markovian 
Bisimulation Equivalence" , in Proc. of PAPM 1998, pp. 153-164. 

[6] P. Buchholz, "Exact and Ordinary Lumpability in Finite Markov Chains", in Journal of Applied Probabil- 
ity 31:59-75, 1994, doi: 10.2307/3215235 

[7] S. Derisavi, H. Hermanns, and W.H. Sanders, "Optimal State-Space Lumping in Markov Chains", in In- 
formation Processing Letters 87:309-315, 2003, doi: 10.1016/S0020-0190(03)00343-0 

[8] W. Henderson and D. Lucie, "Aggregation and Disaggregation Through Insensitivity in Stochastic Petri 
Nets", in Performance Evaluation 17:91-114, 1993, doi: 10. 1016/0166-53 16(93)90002-Cj 

[9] H. Hermanns, "Interactive Markov Chains", LNCS 2428, 2002, doi: 10.1007/3-540-45804^ 

[10] H. Hermanns and M. Rettelbach, "Syntax, Semantics, Equivalences, and Axioms for MTIPP", in Proc. of 
PAPM 1994, pp. 71-87. 

[11] J. Hillston, "A Compositional Approach to Performance Modelling", Cambridge University Press, 1996, 

doi: 1 0. 1 1 7/CBO97805 1 1 56995 1 
[12] K. Matthes, "Zur Theorie der Bedienungsprozesse" , in Proc. of the 3rd Prague Conf. on Information 

Theory, Statistical Decision Functions and Random Processes, pp. 513-528, 1962. 
[13] R. Milner, "Communication and Concurrency", Prentice Hall, 1989. 

[14] G. Rubino and B. Sericola, "Sojourn Times in Finite Markov Processes", in Journal of Applied Probabil- 
ity 27:744-756, 1989, doi: 10.2307/3214379 

[15] W.J. Stewart, "Introduction to the Numerical Solution of Markov Chains", Princeton University Press, 
1994. 



